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Abstract 

Background: Visualization of Concepts in Medicine (VCM) is a connpositional iconic language that ainns to ease 
infornnation retrieval in Electronic Health Records (EHR), clinical guidelines or other nnedical docunnents. Using VCM 
language in medical applications requires alignment with medical reference terminologies. Alignment from Medical 
Subject Headings (MeSH) thesaurus and International Classification of Diseases - tenth revision (ICDIO) to VCM are 
presented here. This study aim was to evaluate alignment quality between VCM and other terminologies using 
different measures of inter-alignment agreement before integration in EHR. 

Methods: For medical literature retrieval purposes and EHR browsing, the MeSH thesaurus and the ICDIO, both 
organized hierarchically, were aligned to VCM language. Some MeSH to VCM alignments were performed 
automatically but others were performed manually and validated. ICDIO to VCM alignment was entirely manually 
performed. Inter-alignment agreement was assessed on ICDIO codes and MeSH descriptors, sharing the same 
Concept Unique Identifiers in the Unified Medical Language System (UMLS). Three metrics were used to compare 
two VCM icons: binary comparison, crude Dice Similarity Coefficient {DSCcrude)> and semantic Dice Similarity 
Coefficient {DSCsemantic)> based on Lin similarity. An analysis of discrepancies was performed. 
Results: MeSH to VCM alignment resulted in 10,783 relations: 1,830 of which were manually performed and 8,953 
were automatically inherited. ICDIO to VCM alignment led to 19,852 relations. UMLS gathered 1,887 alignments 
between ICDIO and MeSH. Only 1,606 of them were used for this study. Inter-alignment agreement using only 
validated MeSH to VCM alignment was 74.2% [70.5-78.0]ci95o/o, DSCcrude was 0.93 [0.91-0.94]ci95o/o, and DSCsemamic was 
0.96 [0.95-0.96]ci95o/o. Discrepancy analysis revealed that even if two thirds of errors came from the reviewers, UMLS 
was nevertheless responsible for one third. 

Conclusions: This study has shown strong overall inter-alignment agreement between MeSH to VCM and ICDIO to 
VCM manual alignments. VCM icons have now been integrated into a guideline search engine (www.cismef.org) 
and a health terminologies portal (www.hetop.eu). 

Keywords: Terminology as topic. International classification of diseases. Medical subject headings. Vocabulary, 
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Background 

Finding pertinent medical information in a complex 
Electronic Health Record (EHR) [1,2] or inside guide- 
lines [3] is a time-consuming task for physicians [4]. 
Visualization of Concepts in Medicine (VCM) is a com- 
positional iconic language created by Lamy et al [5] to 
ease this burden. VCM language has previously been 
used in a graphical interface for accessing drug know- 
ledge, allowing physicians faster access to drug know- 
ledge than with textual interface, and with fewer errors 
[6]. VCM can represent various signs, diseases, physio- 
logical states, risks, antecedents, drug and non-drug 
treatments, laboratory tests, and medical follow-up pro- 
cedures by combining a small number of graphical prim- 
itives: colors, shapes and pictograms. For instance, the 
icon symbolizing "renal failure" is composed of a "kid- 
ney" pictogram, a downward arrow representing "dimin- 
ished function", and a red color standing for "current 
patient status". VCM does not aim to achieve the same 
level of detail as natural language texts, but rather a 
broader level of detail. VCM icons can be used in med- 
ical applications for visually filtering information or for 
graphical summary. It has been implemented by Vidal®, 
the leader in drug databases in France, in its on-line 
guidelines^ and it is used by Sherbrooke Health Expert- 
ise Center for e-learning. 

To allow this, the terminology used in the medical appli- 
cation has to be aligned to VCM language, i.e. each concept 
of the terminology has to be aligned to one or more VCM 
icon. For example, associating VCM icons with patient con- 
ditions coded in EHR with the tenth revision of the Inter- 
national Classification of Diseases (ICDIO), requires iconic 
representation of each ICDIO code using VCM language. 
These alignments may also ease indexing and information 
retrieval, EHR visualization, as well as reading of Summary 
of Product Characteristics etc. 

Alignment errors could lead to false display in the med- 
ical application and, possibly, to medical error. It is there- 
fore important to limit these errors. The subjectivity of 
alignment [7] makes quality evaluation difficult and time- 
consuming. A potential method for performing such evalu- 
ation is inter-alignment agreement, as in indexing [8]. 
Several similarity metrics may be used to compare two 
alignments: icon comparison (are two icons identical?), 
elementary comparisons (is each compositional element of 
two icons identical?) and semantic comparison (do two 
icons share the same meaning?). 

This study presents the alignment of two commonly used 
terminologies: ICDIO and Medical Subject Heading 
(MeSH), to VCM. The aim of this work was to evaluate 
alignment quality before integrating VCM in EHR. Based 
on a small proportion of MeSH to VCM alignment that 
had already been manually validated, three inter-alignment 
consistency measures were used: crude concordance and 



two measures based on Dice index, with or without 
semantics. 

Methods 

VCM iconic language (v2.07) 

Each VCM icon is based on a combination of 7 compo- 
nents [5]. For each VCM icon, 5 out of 7 components de- 
termine the central color, the shape, the central pictogram, 
the top right color and the top right pictogram (see 
Figure 1). The two others are designed for a specific pur- 
pose and are not used in this study. Each component ac- 
cepts a limited number of values called "primitives", some 
of which allow multiple primitives. The use of combinatory 
grammar allows generation of billions of icons from these 
primitives (see Figure 2). Because of overlapping between 
some primitives, or nonsensical combinations, not all icons 
are allowed (such rules were formalized in [9]), but many 
are still valid. Note that all the components except central 
color and shape can be set to null. Primitives are organized 
hierarchically: the central pictograms of the examples in 
Figure 3 are linked by a "Broader Than - Narrower Than" 
relationship viz. the "Thyroid" central pictogram, which is a 
"child" of the "endocrine system" pictogram. As physicians 
do not have the time to learn complex iconic language, 
VCM has been designed to be learned in a few hours. 
Therefore, the hierarchy is very simple: 221 different primi- 
tives for a maximum of six levels. For a complete descrip- 
tion of VCM language, interested readers may refer to: 
http://projet4-limbio.smbh.univ-parisl3.fr/Joomla/. 

Reference terminologies 

In this study, two reference terminologies were aligned 
to VCM iconic language: MeSH Thesaurus [10] of the 
US National Library of Medicine (NLM) in its 2011 ver- 
sion, mostly used for indexing and information retrieval 
of medical literature in MEDLINE, and the French ver- 
sion for Diagnosis Related Group of ICDIO [11], built 
for mortality statistics, but frequently used to code med- 
ical visits for budget allocation. These terminologies are 
widely used in the health domain. 

The MeSH thesaurus has two different levels. The first 
one is the descriptor level, which is for users, and the 
focus of this work. It consists in a "small" (n~ 27,000) 
set of terms used for indexing and information retrieval. 
The second one is the concept level: each MeSH de- 
scriptor is the union of one or more MeSH concepts 
(n ~ 50,000^). MeSH concept meaning may differ slightly 
from MeSH descriptors. It is a poly-hierarchic thesaurus, 
whereas ICDIO is a mono-hierarchic classification. 

The V2010AB of the Unified Medical Language 
System Metathesaurus (UMLS) [12] was also used for 
this study. It is an NLM project that integrates several 
health terminologies and ontologies. Terms belonging to 
different terminologies but sharing the same meaning 
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Figure 1 Examples of VCM primitives. 



are gathered under the same Concept Unique Identifier 
(GUI). ICDIO and MeSH are both integrated into the 
UMLS and some concepts shared the same GUI. 

All terminologies used here (including VCM), as 
well as their relationships, are accessible via the 
Health Terminologies/Ontology Portal (HeTOP; URL: 
www.hetop.eu) [13,14]. 

Alignments between terminologies 
MeSH descriptor to VCM alignment 

Automatic approaches were first used to align MeSH to 
VCM. Natural language processing, stemming [15] and 
lemmatization techniques were tried but led to disap- 
pointing results. Only 1.6% of MeSH descriptors of 
interest were aligned. It was therefore necessary to 



Oral drug preventing pregnancy 



^^^^^ Antifungal drugs 



1 Pathologically increased heart rate 



Figure 2 Some examples of VCM icons. 



perform this alignment manually. This task was per- 
formed by GK [16], a medical librarian. It was an itera- 
tive process leading to the addition of new icons and 
guidelines regarding VCM use. 

Some categories of the MeSH thesaurus, such as names 
of living organisms or geographical names, were not taken 
into account because they were outside of the scope of 
VCM. Every MeSH descriptor within a relevant category 
was examined and manually aligned to a VCM icon. During 
this process, if the expert considered that all sons of one 
term should share the same icons as the father, they inher- 
ited it. Problems arose when one son had many fathers: 
then an automated algorithm assigned it VCM icons from 
its closest parent, using a simple node counting scheme 
(see Figure 4). This resulted in two different types of rela- 
tionships between VCM icons and MeSH descriptors: man- 
ual vs. automatic. Each manual alignment was reviewed by 
at least one of the VCM designers (JBL, CD and AV). The 
final alignment was obtained by consensus. This alignment 
allowed the use of VCM in a clinical guideline search en- 
gine [17]. 

ICDIO to VCM alignment 

NG, a public health resident, performed ICDIO to VCM 
alignment. Each ICDIO code was manually aligned to 
VCM. 

Alignment between MeSH and ICDIO 

To compare VCM icons aligned to MeSH and VCM 
icons aligned to ICDIO, alignment between MeSH and 
ICDIO was necessary. The latter was provided by UMLS, 



Griffon et al. BMC Medical Informatics and Decision Making 2014, 14:1 7 
http://www.bionnedcentral.conn/1472-6947/14/17 



Page 4 of 9 





Concepts sharing the same GUI = C0040149 


Thyroiditis, subacute 
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thyroiditis (ICDIO) 


VCM icon 
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Current condition 
Disease 
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Current condition 
Disease 
Inflammation 
Thyroid 



Figure 3 Primitive composition of VCM icons for two terms sharing the same CUI. 



and more specifically by selecting ICDIO codes and ICDIO codes and MeSH descriptors were used, because 
MeSH descriptors sharing the same CUI [18]. of difficulties comparing more than two icons. There- 
fore, if one ICDIO code or one MeSH descriptor was 
Evaluation aligned to more than one VCM icon, it was discarded 
Only manual MeSH to VCM alignments were already from the study. 
vaUdated, and used to evaluate ICDIO to VCM align- 
ments, which could in turn be used to validate auto- Measuring inter-alignment agreement 
matic MeSH to VCM alignments. For each alignment Concordance was defined as the proportion of align- 
between MeSH and ICDIO, the following information ments in which the ICDIO code icon and the MeSH de- 
was extracted: the MeSH descriptor, the relationship be- scriptor icon were identical. To refine this rough 
tween the MeSH descriptor and the VCM icon, the measure of inter- alignment agreement, the Dice Similar- 
VCM icon aligned to the MeSH descriptor, the ICDIO ity Coefficient (DSC) [19] was used to compare icons 
code, and the VCM icon aligned to the ICDIO code. based on their primitives. DSC is equivalent to Fleiss' 
Only alignments concerning one VCM icon for both positive specific agreement [20], and as there are many 



Disease category 
Digestive system diseases I 
Liver diseases Q 

C Hepatic insufficiency ^ 
Liver failure 
Hepatic encephalopathy 
Nervous system diseases 
Central nervous svstem diseases 
Brain diseases km 
Distance = 2 (^Brain diseases, metabolic Qj* 
^ Hepatic encephalopathy 
Nutritional and metabolic diseases 
Metabolic diseases 

^. . ^ ^ Brain diseases, metabolic 

Distance = 2 C . ' , , 

^ Hepatic encephalopathy LjJ^ 

Figure 4 Relationships between MeSH and VCM icons. A short insight into MeSH hierarchy: Italic terms are automatically aligned with VCM 
whereas other terms are manually aligned. "Hepatic encephalopathy" (bold) inherits its icons from the closest parent (path length) manually 
aligned: "Brain diseases, metabolic". 
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primitives (n = 221), it is also equivalent to kappa coeffi- 
cient [21,22]. 

Two DSC were calculated: a crude one {DSCcrude) and a 
semantic one {DSC semantic)- DSC crude strictly compared 
VCM icon primitives, whereas DSCsemantic took meaning 
into account. DSCcrude was computed as follows: 



DSCcrudeih^h) 



2 X |Pr(/i)nPr(/2) 
|Pr(/i)| + |Pr(/2)| 



(1) 



where Pr(Ij) is the set of primitives for icon Ij. 

DSCsemantic was Calculated combining the DSCcrude 
equation (1) with Lin semantic similarity [23]: 



sim{yvi^ Pry) 



2 X 



^a^Pr.5(Pr,Pr,){log[^(P0]} 

log[^(PrO]+ log[^(Pry)] 



(2) 



Where S(Pri,Prj) represents the set of ancestor primitives 
shared by both Pri and Prj, "max" represents the maximum 
operator, and p(Pr) is the probability of finding Pr in a refer- 
ence corpus (here, the probability of finding Pr as a primi- 
tive in the entire set of MeSH to VCM and ICDIO to VCM 
alignment). Lin similarity lies between 0 (when the only 
common ancestor is the root tree) and 1 (when Pri = Prj). 

To compute DSCsemantic^ the numerator of equation 
(1) is replaced by Lin semantic similarity: the presence 
of a primitive in the intersection between the two sets of 
primitives is replaced by the best semantic similarity be- 
tween this primitive and the set of primitives for the 
other icon [24]. DSCsemantic formula is: 



DSCse 



max[s/m(Pr2, Pry)] + ^ max[5/m( Pr^, Pry)] 



|Pr/il + |Pr/2l 



(3) 



Where sim(Pri,Prj) is computed using equation (2), 
and / and ; are the number of primitives in Ii and I2, 
respectively. 

Table 1 Computing DSC 



The three metrics (DSCsemantic DSCcrude and concord- 
ance) ranged from 0 to 1, two identical icons having a 
DSC of 1. Figure 3 shows the primitives which com- 
posed the VCM icons corresponding to CUI C0040149 
"Subacute thyroiditis". Intersection and best similarities 
between these primitives are shown in Table 1. 

For these two different icons, DSCcrude = ^1'^ and 

DSCsemantic — 6.05/7. 

The three metrics were compared between icons ac- 
cording to the relationship between MeSH descriptors 
and VCM icons (automatic vs. manual), using Wilcoxon/ 
Fisher tests. 

Discordance analysis 

A random sample of 35 discordances, involving MeSH 
descriptors that were manually aligned to VCM, has 
been reviewed by experts (GK and NG) to assess the 
reasons for discordance. 

Results 

Alignments 

Alignment from MeSH to VCM was performed manu- 
ally for 1,830 MeSH descriptors and automatically (ac- 
cording to MeSH hierarchies) for 8,953 MeSH 
descriptors. It was not possible to measure the time 
spent performing this alignment since it was part of the 
evolution process of VCM. Alignment from ICDIO to 
VCM was totally manual. It took almost 70 hours to 
manually align the 19,852 ICDIO codes to VCM icons 
(see Table 2 for summary statistics concerning these 
alignments). 

There were 1,887 alignments between ICDIO and 
MeSH using UMLS concepts. For 1,606 of them, there 
was one icon for the ICDIO code and one icon for the 
MeSH descriptor (85.1%). This study focused on these 
1,606 concepts, since comparing more than two icons 
would have been too complex. There were 528 manual 
alignments and 1,078 automatic alignments between 
MeSH descriptors and VCM icons. 
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Table 2 Number of VCM icons by ICD10 code or MeSH descriptor, according to the relationship 

VCM icons (N) Total 



1 2 3 4 5 6 7 



ICDIO code 




12,966 


6,005 


838 


38 


5 


0 


0 


19,852 




All 


9,385 


1,070 


262 


55 


8 


2 


1 


10,783 


MeSH descriptor 


Manual 


1,794 


36 


0 


0 


0 


0 


0 


1,830 




Automatic 


7,591 


1,034 


262 


55 


8 


2 


1 


8,953 



How to read: MeSH descriptors with iconic representation = 10,783; Including 1,830 with manual representation, 1,794 of which are represented by 1 VCM icon, 
the other one is represented by 2 VCM icons. 



Inter-alignment agreement 

Figure 3 shows an example of disagreement between 
two terms sharing the same GUI: "Thyroiditis, subacute" 
from MeSH and "Subacute thyroiditis" from ICDIO. 

Comparing MeSH Descriptor icons with ICDIO code 
icons showed that agreement differed according to align- 
ment between VCM and MeSH. For all metrics, "manual" 
relationships were significantly better than "automatic" ones 
(see Table 3). 

Discordance analysis 

Reviewing discordances between the MeSH expert and 
the ICDIO expert revealed that most errors came from 
the experts (60.0%; [44-76] 950^ ci)> almost equally from 
the ICDIO expert (31.4%; [16-47]95o/„ ci) and the MeSH 
expert (37.1%; [21-53]95o/„ q; for some alignments, both 
experts were wrong). These errors consisted, in general, 
in a lack of specificity: no icons were wrong, but one 
was more precise than the other. Nevertheless, as shown 
in Figure 5, the UMLS was also responsible for an im- 
portant part of the discrepancies (31.4%; [16-47]95o/„ ci). 
Lastly, few errors were caused by VCM itself: a lack of 
definition in primitives induced one error, and a lack of 
coherence in VCM s rules of formalism led to two errors. 
See Additional file 1 for a complete description of 
discrepancies. 

Discussion 

Inter-alignment agreement showed a concordance of 74.2% 
for fully manual alignments. The results are even better 
using Dice Similarity Coefficient: mean DSCcmde = 0-93 
and mean DSCsemantic = 0-96. Both can be interpreted, like 
Cohens Kappa, as excellent [25] or almost perfect [26]. The 
results are less satisfying with automatic alignments: 



concordance dropped to 60.5%, and there was a decrease in 
both DSC to 0.88 and 0.92 respectively. Discordance ana- 
lysis shows that discrepancies resulted mostly from experts 
(60%) or UMLS (31%). 

Comparing automatic alignment to gold standard align- 
ment (manually created by an expert) is frequent in the lit- 
erature [27,28]. Conversely, few studies to date have 
compared two manually created alignments. Wieteck [29] 
compared inter-alignment agreement between two nursing 
terminologies: the European Nursing care Pathway, which 
is mono-axial, and the International Classification for 
Nursing Practice (ICNP), which is multi-axial. Agreement 
was measured for each of the eight ICNP axes and ranged 
from 73% to 100%. This led to an estimated overall inter- 
alignment agreement ranging from 53% to 70% for fully 
manual alignment. The results presented here are better 
than Wietecks [29] for manual alignment, especially for 
similarity metrics. 

One explanation for these improved results could be the 
relatively low granularity of VCM iconic language with a 
maximum of six hierarchy levels, whereas the MeSH the- 
saurus has a maximum of 11 hierarchy levels. Nevertheless, 
the compositionality of VCM allows the creation of more 
icons than existing MeSH terms: according to VCM ontol- 
ogy, there are millions of coherent, consistent icons. This 
does not mean that each of these icons is meaningful. 
Today, more than 2,500 different icons have been created 
and linked to MeSH, ICDIO, ATC or SNOMED. 

Analysis of discrepancies revealed that alignment dif- 
ferences between VCM to ICDIO and VCM to MeSH 
may be the result of: 

- Firstly, VCM to MeSH alignment was performed by 
a medical librarian (GK), whereas VCM to ICDIO 



Table 3 Results from comparison of ICD10 code VCM icons and MeSH descriptor VCM icons 



MeSH to 
VCM 

relationship 



Total (n = 1,606) 



Manual (n = 528) 



Automatic (n = 1,078) 



Mean/% 



[Ci95°/o] 



Mean/% 



[Ci95°/o] 



Mean/% 



[Ci95°/o] 



Concordance 

DSCcrude 
DSCsemantic 



65% 
0.90 
0.93 



[62.6-67.3] 
[0.89-0.90] 
[0.93-0.94] 



74.2% 
0.93 
0.96 



[70.5-78.0] 
[0.91-0.94] 
[0.95-0.96] 



60.5% 
0.88 
0.92 



[57.5-63.4] 
[0.87-0.89] 
[0.92-0.93] 



^< 10" 
^< 10" 
^< 10" 



*: Fisher test. ^: Wilcoxon test. 
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Figure 5 Analysis of discrepancies (n = 35). 



alignment was performed by a medical resident 
(NG). Consequently, alignment differences could be 
explained by different education and point of view 
regarding the disease. The purpose of the semantic 
similarity measure (DSCsemantic) is to decrease the 
weight of such differences. 

- Secondly, sharing the same UMLS CUI is 
sometimes questionable based on the different 
contexts that led to the creation of the different 
terminologies (e.g. medical literature for MeSH, 
mortality statistics for ICDIO) [30]. It is often the 
result of UMLS CUI linking an ICDIO code and a 
MeSH concept with narrower meaning than the 
MeSH descriptor used in this study. Nevertheless, 
those approximate links provide results of similar 
quality to more regular links, i.e. when MeSH 
concept and MeSH descriptor have exactly the same 
meaning (data not shown). 

- Lastly, differences in alignment could be explained 
by the different contexts of terminology in current 
use (e.g. billing for ICDIO, indexing and information 
retrieval for MeSH). 

This study has potential limitations. Firstly, it was 
based on a rather uncommon situation, with three dif- 
ferent coexisting manual alignments: (1) MeSH to 
ICDIO alignment through UMLS (same CUI), (2) VCM 
to MeSH alignment and, (3) VCM to ICDIO alignment. 
VCM to MeSH alignment was performed first, then 
VCM to ICDIO thereafter. NG was not totally blind in 
performing the VCM to MeSH alignment. In case of 
doubt, he was able to use HeTOP [13,14], which had in- 
tegrated VCM to MeSH alignment. Overall, the portal 
was used for a limited number of alignments. Such bias 
could therefore be considered as minimal. A second 



possible source of bias was the exclusion of ICDIO to 
MeSH alignment when more than one VCM icon was 
used for MeSH descriptor or for ICDIO code. Agree- 
ment in these cases might be lower than that observed 
here. However, from the 281 alignments concerned (i.e. 
MeSH descriptor or ICDIO code aligned to more than 
one VCM icon), only 42 involved an already validated 
MeSH to VCM alignment - i.e. manual MeSH to VCM 
alignment. Assuming those 42 were all erroneous, this 
would have led to a concordance of 68.8%, a DSCcmde of 
0.86 and a DSCsemantic of 0-89. It is still an excellent 
inter-alignment agreement, especially compared to the 
literature. Lastly, our results concerned only about 20% 
of MeSH diseases and 10% of ICDIO. Those terms were 
not chosen randomly but rather based on whether they 
were mappable to a UMLS CUI that was also mapped to 
the other terminology. Also, the remaining terms may 
have some systematic characteristics: being more spe- 
cific, with nuances that make them incomplete matches 
etc. This implies that for those terms alignment to VCM 
might require more work, more detailed icons (with 
more primitives) and therefore be more prone to coder 
errors, show lower levels of concordance, similarity and, 
finally, validity. Such differences between UMLS linked 
and non-UMLS linked MeSH descriptors and ICDIO 
codes are difficult to quantify. 

For research and development purposes, both align- 
ments will be maintained in HeTOP, allowing VCM 
to MeSH available in 16 languages (e.g. Japanese and 
Swedish) and VCM to ICDIO in 11 languages (e.g. 
Arabic and Italian). However, industrial partners in the 
L3IM consortium [31] (one small French company and 
one French subsidiary of a north-American company) 
have different perspectives: the same medical concept 
should have the same VCM icon for the end-user, no 
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matter which terminology or classification it was aligned 
from. Such recommendations require a considerable 
amount of expert validation and, probably, some 
changes in VCM hierarchy. 

The high inter-alignment agreement involving already 
validated MeSH to VCM alignments demonstrates the 
validity of ICDIO to VCM alignment, allowing its use in 
ICDIO based EHR to summarize patient conditions, with 
minor modification from editors. Two companies have 
already shown enough interest in VCM to introduce it 
in their products (Silk [32] and McKesson). VCM can 
therefore be considered as a sort of interface termin- 
ology, which was defined by Rosenbloom et al [33] as a 
terminology that "facilitates display of computer-stored 
patient information to clinician-users as simple human- 
readable text". 

The literature suggests that enhanced consistency be- 
tween MeSH to VCM and ICDIO to VCM alignment 
could increase alignment validity [8]. Therefore, finding 
an approach for MeSH to VCM automatic alignment 
leading to consistency similar to that found in "manual" 
relationship would probably facilitate validation of in- 
dustrial recommendations. L3IM intends working on 
such an approach using the ontological version of VCM 
iconic language [9]. 

Conclusion 

This study has shown excellent overall inter- alignment 
semantic agreement between MeSH to VCM and ICDIO 
to VCM manual alignments. ICDIO to VCM alignment 
seems of sufficient quality to be used in medical 
applications. 

Endnotes 

^See http://www.vidal.fr/recommandations/3398/diver- 
ticulose_colique/la_maladie/, for example. 

^Excluding MeSH supplementary concepts, which are 
not used for this study. 
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Additional file 1: Summarizes all the ICDIO/MeSH couples with 
discordant icons that were analyzed. MeSH descriptor and ICDIO code 
on the same line share the same UMLS CUI but do not have the same 
VCM icon. 
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